AN ALMOST SURE INVARIANCE PRINCIPLE FOR RANDOM 
WALKS IN A SPACE-TIME RANDOM ENVIRONMENT 

F. RASSOUL-AGHA AND T. SEPPALAINEN 

Abstract. Wc consider a discrete time random walk in a space-time i.i.d. random 
environment. We use a martingale approach to show that the walk is diffusive 
in almost every fixed environment. We improve on existing results by proving 
an invariance principle and considering environments with an annealed L 2 drift. 
We also state an a.s. invariance principle for random walks in general random 
environments whose hypothesis requires a subdiffusive bound on the variance of 
the quenched mean, under an crgodic invariant measure for the environment chain. 



1. Introduction 

Random walk in a random environment is one of the basic models of the field 
of disordered systems of particles. In this model, an environment is a collection of 
transition probabilities u> = {^xy) X) y^7Ld G V 71 where V = {(p t ) ze ^ G [0, 1] K : 

J2 z p z — 1}- Let us denote by f2 = V 7Z,d the space of all such transition probabilities. 
The space Q is equipped with the canonical product a-field & and with the natural 
shift ir xy (T z Lu) = 7r x+Zty+z (cv) , for z G TL d . On the space of environments (5), 
we are given a certain T-invariant probability measure IP with (Q, &, (T 2 ) ze7L d , IP) 
ergodic. We will say that the environment is i.i.d. when IP is a product measure in 
the sense that the random probability vectors (^ x ,y) ye 7i d are i.i.d. over distinct sites 
x. We will denote by IE the expectation under IP. Let us now describe the process. 

First, the environment uj is chosen from the distribution IP. Once this is done it 
remains fixed for all times. The random walk in environment u, starting at z, is then 
the canonical Markov chain X = (X n ) n > with state space 7L d and satisfying 

P?{X = z) = l, 
P z (X n+1 = y\X n = x) = 7r xy (u>). 
The process P z is called the quenched law. The joint annealed law is then 

P z (dX,duj) = P?(dX)]P(du), 
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and P z (dX , Q) is the marginal annealed law or, by abus de langage, just the annealed 
law. We will use E z and for the expectations under, respectively, P z and P£ ■ 

We begin by considering a special type of random environment. Namely, assume 
that d = v + 1 > 2 and let {ej}^ =1 be the canonical basis of IR d . Assume then that 
IP is i.i.d. and, iP-a.s., 

7To, ei+2 = 0, if z <£ E = {x E 7L d : x ■ e l = 0} ~ TL V . (1.1) 

Condition p.lj) says that at each step the first coordinate increases by one deter- 
ministically. One of the reasons for considering such a model comes from the fact 
that if one views it as a random walk in a //-dimensional space-time i.i.d. random 
environment, with IRei being the time axis, then it turns out to be a dual process to 
some surface growth processes. See, for example, 

Clearly, the annealed process, in this case, is equivalent to [ne\ + Y n ) n > , where Y n 
is a homogeneous Markovian random walk on E, with transitions 

00, x + z) = p(0, z) = lE(n 0iei+z )) XiZGE . 

If p has a first moment, the annealed walk on 7L d has a law of large numbers with 
velocity 

v = ei + y^p(0, z)z. 

Z £E 

If, furthermore, it has a second moment, one then has an annealed invariance principle 
with diffusion matrix 

D = 53(e a + 2r - «)(ei + z - u)*p(0, 

Since any quenched central limit type result would imply an annealed one, one can 
then see that a second moment condition on p has to be assumed, if one wants to prove 
an a.s. invariance principle for this model. On the other hand, if iP(sup 2 ir 0z = 1) = 1, 
then the quenched walk becomes deterministic and a central limit is out of question. 
This justifies our hypothesis (M for moment, E for ellipticity) : 

Hypothesis (ME). The measure IP satisfies the following condition 

y~] \z\ 2 lE(-K^ ei+z ) < oo and iP(sup7r 0iei+2 < 1) > 0. 

z eE Z&E 



Define now, for t > and a given (X n ] 



n>0, 



B n (t) = X ^ and B n (t) = ^ " ■ (1-2) 

'n \ n 



Here, for x G H, [x] = max{n : n < x}. For a closed interval I C [0, oo) denote 
by D M d(I) the space of right continuous functions on /, taking values in lR d , and 
having left limits. The space Z) ]R d(/) is endowed with the usual Skorohod topology 
. For wefl, let Q%, respectively Q^, denote the distribution of B n , respectively 
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B n , induced by P£, on the Borel sets of D U d([0, oo)). In SectionEJwe will prove the 
following theorem: 

Theorem 1. Let d > 2 and consider a random walk in an i.i.d. random environment 
satisfying (jl.lj) and Hypothesis (ME). Then, for IP-a.e. u>, the distribution con- 
verges weakly to the distribution of a Brownian motion with diffusion matrix given 
by D. Moreover, n" 1 ' 2 maxfc<„ \Eq (X n ) — nv\ converges to 0, JP-a.s. and, therefore, 
the same invariance principle holds also for Q^- 

Remark 1. For a symmetric, non-negative definite dxd matrix T, a Brownian motion 
with diffusion matrix T is the IR^-valued process (W(t)) t > such that W(0) = 0, W 
has continuous paths, independent increments, and for s < t the <i-vector W(t) — W(s) 
has Gaussian distribution with mean zero and covariance matrix (t — s)T. If the rank 
of r is m, one can produce such a process by finding a d x m matrix A such that 
T = AA*, and by defining W(t) = AB(t) where B is an m-dimensional standard 
Brownian motion. 

In space-time product random environments the invariance principle under the 
annealed Pq is just Donsker's classical invariance principle. But in general random 
environments even the annealed invariance principle is far from immediate. For recent 
results in this direction see 0| and [Hf and the references therein. Moreover, the 
switch from annealed central limit type results to quenched ones for random walks in 
random environments is a hard problem that has been subject to a very slow progress. 

Quenched results have been proved under specialized assumptions. For example, if 
the random walk is balanced (i.e. tto x = iro_ x ), then X n becomes a martingale under 
the quenched measure, and one can show a quenched invariance principle [l •">•' . On the 
other hand, if the random walk has a sufficiently high-dimensional simple symmetric 
random walk part, then one can use a natural regeneration structure that arises 0|. 
If the random environment is a small perturbation of the simple symmetric random 
walk, then a quenched invariance principle has been proved using renormalization 
techniques; see and the recent [24j . Even in the basic reversible case of random 
walks among random conductances, quenched invariance principles have only recently 
been shown to hold |2(|. There the authors adopt the approach developed by Kipnis 
and Varadhan 0] for reversible Markov chains to get a central limit theorem; see 
Section |3] below. Also, see 0] and 3| for a review on the approach in 0. For 



a non-reversible setting where [13[ has also been useful, see |25|. Notably, as it is 
usually the case in this field, the invariance principle does not immediately follow 
from the fixed time central limit theorem. In [20j , recent Gaussian estimates are used 
to perform the transition. 

In the case of a space-time product environment, the central limit version for B n (l) 
has been known in the case of small noise; see and In the recent j3| the authors 



remove the "small noise" assumption and prove the fixed time central limit theorem 
under the hypothesis that sup w vr 0z (u;) has an exponential moment, as opposed to our 
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second moment assumption in Hypothesis (ME). If one assumes on top of Hypothesis 
(ME) that P-a.s., 7To )ei + 2 = 0, if z {ej, — ej}j> 2 , and positive otherwise, then the 
invariance principle for the process B n in dimension d > 4 has been proved in pj. 

Our arguments are different from The ideas in Q and |2(| are somewhat related 
in spirit. Our approach is based on adaptations of the well-known Kipnis-Varadhan 
method L^ to non-reversible situations developed by Maxwell and Woodroofe 2 



and Derriennic and Lin Maxwell and Woodroofe use fairly concrete probabilistic 
reasoning. We will refer directly to their paper for some preliminary steps in our 
proof. The approach of Derriennic and Lin is more abstract and powerful, cast in the 
framework of Banach space contractions, and ultimately produces stronger results. 
We apply their results to conclude our proof. All this will be described in Section |21 
where we prove a result that holds for general random environments. 

In the course of this paper u, uq, and oj\ will denote generic elements of Q. We 
will write A* for the transpose of a vector or matrix A. An element of IR d is regarded 
as a d x 1 matrix, or column vector. The set of whole numbers {0, 1, 2, • • ■ } will be 
denoted by IN. 

2. Quenched invariance principle for general random environments 

under moment hypotheses 

In this section we consider the general random walk in a random environment as 
formulated in the first two paragraphs of the Introduction. In particular, the special 
structure of assumption and Hypothesis (ME) are not assumed in this section. 

First, let us define the drift 



D(u) = E%(X 1 )=J2^ 0z 



For a bounded measurable function h on Q, define 

Uh(u) = y ^it Qz {u)h(T z u)). 

z 

In fact, n — / defines the generator of the Markov process of the environment, as seen 
from the particle. This is the process on Q with transitions 

tt(uj,A) = Pq(T Xi uj £ A). 

In this section, we will assume there exists a probability measure P^ on Q that is 
invariant for the transition n. Then, the operator n can be extended to a contraction 
on LP (Poo), for every p G [1, oo]. We will use the notation P^ for the correspond- 
ing expectation. When the initial distribution is Poo, we will denote this Markov 
process by P °°. We will also write^P oo (rfA > , du) = P^d^P^duo) and for the 
expectation under P£°. Note that P °° is the probability measure induced by P£° and 
(Tx n w) onto . With this notation, the measure 

^((Lj^duji) = n^uo.du^PooiduJo) 
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describes the law of (uj,Tx l uj), under P£°. 

We will assume in this section that D G L 2 (iP oc ). Next, for e > 0, let h £ be the 
solution of 

(1 + e)h £ - Tlh £ = g = D — v, 
where v = lE^D). In fact, one can write: 

oo 

K = Y^il + e)- k U k - 1 geL 2 {]P 00 ). 

k=l 

Define 

H^ujq,^) = /i 6 (wi) - Ilh £ (LJ ). 
Then one has the following theorem. 

Theorem 2. Let d > 1 and let IPoq be any probability measure on (Q, (5) that is 
invariant under U and ergodic for the Markov process on Q with generator U — I. 
Assume that \z\ 2 JE 00 (7To z ) < oo. Assume also that there exists an a < 1/2 such 
that 

n-1 
k=0 



\j lEoo (\E%(X n ) 



nv\ 



0{n a ), (2.1) 



where ||-|| is the LP^F^-norm. Then we get the following conclusions: The limit 

H = lim H £ (2.2) 



exists in L 2 (/iJf ). For P^-a.e. to, the distribution of the process B n defined in 
M.fy) converges weakly to the distribution of a Brownian motion with diffusion matrix 

[{X x - D(u) + H(u, TxM){Xi - D(u) + H(u, T Xl u)f] , (2.3) 

as defined in Remark^ Moreover, n _1 / 2 maxfc< n \Eq (Xf.) — kv\ converges to 0, JPoo- 
a.s. and, therefore, the same invariance principle holds for Q^- 

REMARK 2. When (|2.1|) only holds for a = 1/2, e.g. when d — 1, the quenched 
central limit theorem may only hold with random centering Eq(X u ) and not with 
deterministic centering nv. See Examples 3 and 4 and Proposition 1 of ["Lsl ]. 



Proof. The proof uses essentially the strategy of 0] which is an extension of some of 
the results of 0] , to which in turn we will refer the reader for part of the calculations. 
First let us give a few more definitions. For e > 0, let 

n—1 n—1 

Ml = Y,H £ (T Xk u,T Xk+1 u), X n = X n -Y.DiTx.u). 

k=0 k=0 
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Furthermore, define 

n-l 

S£ = Y,he(T Xk u), Rl = h E (u) - h E (T Xn u), 

k=0 

so that 

X n - nv = X n + M £ n + eS £ n + P n . 

Now, we proceed with the proof. The existence of the limit in ()2.2|) follows from 
Proposition 1 of 0| . Thus, if one defines 

n-l 

M n = Y,H{T Xk u,T Xk+1 u), 

k=0 

then, for iP^-almost every to, (M n ) n >x is a P^-square integrable martingale relative 
to the filtration \T n = cr(X , • • • , X n )} n > . It also follows from Lemma 1 of |l6| that 
one has \\h £ \\ 2 = (7(e~ a ). Define the error by 

R n = X n - nv - X n - M n = Ml - M n + eS e n + R e n . (2.4) 

Corollary 4 of 0] shows that 

E™(\R n \ 2 ) = (J{n 2a ). (2.5) 

Let M*{t) = n- l l 2 {X [nt] + M [nt] ). {M*{t)) < t <i converges weakly, under P£ for 
iPoo-a.e. u, to a Brownian motion with diffusion matrix as in (J2.3J) . This follows 
from a vector-valued version of a well-known invariance principle for martingales. 
For the convenience of the reader we provide a proof of it in the appendix. The 
limits needed as hypotheses for this invariance principle follow from ergodicity and 
the square- integrability of Mi and X±. In turn, the assumption \ z f -^oo( 7r oz) < 00 
guarantees that X\ and M\ are square-integrable for iP^-a-e. u. 

We have 

sup \B n (t) -M*(t)\ < rr 1/2 max|i4| . 
o<t<i k < n 

Therefore, the invariance principle for (B n (t))o<t<i will follow once we show that 

rT 1 / 2 max \R^\ — > 0, in P^-probability, for iPoo-a.e. u. (2.6) 

k<n n^oo 

By (|2.4|) . Eq(R u ) = E^(X n ) — nv. Hence the invariance principle for the process 
(-B n (t))o<t<i will follow once we show that 

rT 1/2 max\E%(R k )\ — > 0, for P^-z.e. u. (2.7) 

k<n n— *oo 

To prove (|2.6|) and ()2.7|) we apply the theory of "fractional coboundaries" of Der- 
riennic and Lin The first application is to the shift map 9 on the sequence 
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space which is a contraction on the space L 2 (P£°). On Q x Q define first 
/(wo,Wi) = g(uj ) - H(loq, iOi). Then, P °°-a.s. 

n-1 

R n = ^2f{T Xk uj,Tx k+1 uj). 
For sequences u = (co^) ie ^ E £1^ define F(uj) = f(cu^°\uj^) and 

n-1 

R n = Y,Fo6 k . 

k=0 

Then F E L 2 (P£°) and the process (P n )n>i has the same distribution under P °° as 
the process (R n )n>i has under P^. 

Condition ()2.5|) shows that the assumptions of Theorem 2.17 of |j| are satisfied. 
The conclusion is that F E (I - 6»)' 7 L 2 (P 00 ), for any 77 e (0, 1 - a). Since a < 1/2, 
we can find such an 77 G (1/2, 1 — a). But then (i) in Theorem 3.2 of (if implies that 
n~ l l 2 R n converges to 0, P^°-a.s. This implies that n~ l l 2 R n converges to 0, P °°-a.s. 
In other words, n~ l l 2 R n converges to 0, P^-a.s., for iPoo-a.e. u. From this, ()2.6|) is 
immediate. 

To prove ()2.7j) apply the same results from to the contraction II on L 2 (iPoo). 
Because 

n-1 

E$(R n ) = E%(X n ) -nv = J2 n k 9 

repeating the above argument with 9 replaced by II and (|2.5J1 replaced by (j2.1|) proves 

Once we have the invariance principle on £^([0, 1]), the identities 

B n (t) = VNB nN (t/N) and B n (t) = y/NB nN (t/N) 

show that on P^dQC), N]) B n and B n converge to the process \/~NW(t/N) which is the 
same as W. Then weak convergence on each D M d([0, N]) implies weak convergence 
on £^([0, 00)). The proof of Theorem|2]is complete. □ 

3. On the corrector function 

In this section, we will prove an interesting property of the error R n defined in (|2.4jl . 
This property will show the key difference between the one and multi-dimensional 
cases. Although we will not make use of this property, it establishes a connection 
with other existing ways of approaching the problem; see j^j , for instance. 

First, define the functions 

f e {u , wi) = g(co ) - H £ (u , cji) - eh e (u ), 
f(u , cot) = g(u> ) - H(u , wi). 
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A calculation shows us that 

/ 6 (w ,£*;i) = h E (uj ) - he(ui), 

n-l 



R n-^2 fe{T Xk ^, T Xk+1 i 
k=0 
n-l 



k=0 
n-l 

f(T Xk u,T Xk+1 u) 

k=0 

The following proposition establishes a "co-cycle" property of /. 

Proposition 1. For m,n e IN, let ((xj)™ =0 , (xj)™ =0 ) be "an admissible bridge", 
i.e. such that x n = x m = x, and 

J Po(Xi =x h 0<i< n)P${Xj = Xj, < j < rr^P^dw) > 0. 

Then, one has 

n—l m — 1 

^2f(T x .uj,T x . +1 aj) = ^2f(T s .u,Tz j+1 uj), P^-a.s. (3.1) 

i=0 j=0 

Proof. Fix m, n and x, and let Qo xnm be the measure on the space of double paths 
((xi)f =0 , (xj)'jL =Q ) defining two independent random walks driven by the same environ- 
ment u, both starting at and ending at x after, respectively, n and m steps. That 
is, 

n—l m—1 

Qo, X ,n,m(((Xi)to, (%)f=o)) = II II "Mi 

i=0 j=0 

if x n = x m = x, Xq = x = 0, and otherwise. Define also 



Qo,x,n,m — J Q )o,x, n,m^ 'txj(^)- 



Then one has, for each e > 0, 

n—l m—1 

^fe(T Xt UJ,T Xi+1 u) = ^2f £ (T Xj UJ,T Xj+i Uj), Qo,x,n,ra-a.S. 
i=0 j=0 

By (12. 2|) each term above converges, in L 2 (P£°), to the corresponding term in (|3.1[) . 
Note now that, although Qo xnm is not a probability measure, one still has -%gsr g < 
1. Therefore, the convergence also happens in L 2 (Qo,a;,n,m) and as a result 

n—l m—1 

^/(T Xi ^,T Xi+1 ^) = ^2f(T Xj u,T Xj+i u), Q^ n m -a.s., for F M -a.e. w. 

i=0 j'=0 

Therefore, ()3.1|) holds for any admissible bridge. □ 



AN A.S. INVARIANCE PRINCIPLE FOR RW IN SPACE- TIME RE 



!) 



Let us, for simplicity, assume that all points in 7L d can be reached from by some 
admissible path. The above Lemma tells us then that if one defines the so-called 
"corrector function" as 

m— 1 
i=0 

where (xq, ■ ■ ■ , x m ) is any admissible path from to x, then 

R n = x(X n ,u) = x([nv],u) + x(X n - [nv],T [nv] u). (3.2) 

Here, for x G IR d , [•] acts on each coordinate separately, to give [x\. Relation (|H.2jl 
has a quite interesting implication. The term x([?w],u;) represents the fluctuations 
coming from the environment itself. When d — 1, x{[ nv ]i u >) is °f order y/n and for 
a quenched invariance principle one needs to consider X n — nv — x([nt>], cu), i.e. to 
have a random centering. See |26| and Example 4 of [3] for more details. However, 
when d > 2 the walker can see "more" environments. The quantity x( -^'"- ) then 
vanishes at the limit and condition (|2.6|) has a chance to hold. See |2(j for a result 
where control of the corrector is key to a quenched invariance principle in a reversible 
setting. 

4. Space-time i.i.d. random environments 
In this section, we will prove Theorem ^ via an application of Theorem |21 
of Theorem^ For n > 0, let 

f n (u)= ^(*n = 0). 

x:x-ei=— n 

By translation invariance of IP one has E(f n ) = 1. One then can check that f n is a 
martingale relative to the filtration 

{6_ n = a((7r xy )y, x ■ ei > -n)} n > . 

Therefore, there is a probability measure iPoo such that 



fn- 



An induction on / n shows also that is invariant for n. Since fo = 1, we have that 
IP = IPoq on (So- This will be of great use to us. On the one hand, since {hq z ) z is 
©cr measura kle, Hypothesis (ME) implies that D G L 2 (iP oc ). On the other hand, on 
©o the i.i.d. structure carries over to Poo- Using this, we will show in the following 
lemma that is also ergodic for the Markov process with generator n — /. 

Lemma 1. If IP is i.i.d. and satisfies (jl.ljl . then the invariant measure Poo, con- 
structed above, is ergodic for the Markov process with generator U — I. 
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Proof. Consider a bounded local function \1/ on Q that is measurable with respect to 



<T {{ 7r xy)y, \x ■ ex\ < K), for some integer K > 0. Due to (^(T x 



7TT.Q -\-3Km 



<^))m>0 I s 



a sequence of i.i.d. random variables, under Pq, for any tuq > K. Therefore, 

E Q {^{T Xm u)) 



Po ( Vm > K : lim n" 1 ^ 

\ 3Km<n—mo 



3K 



1. 



It then follows that, IP-a.s. 

P£ ( lim r^ 1 £ *(T Xm „) = c ) = 1, 



n-1 



where 



m=K 
4K-1 



c=(3Ky 1 E ^(T Xmo u;)). 

mo=K 

Since the above quenched probability is ©o-measurable the convergence also holds 
iPoo-a.s. But then c cannot be anything other than iE' 0O (^ r ). 

By bounded convergence one then sees that n _1 Y^m=o n m \I/ converges to iE' 00 (\l/), 
iPoo-a.s. By L 1 -approximations we get this same limit in the L 1 sense for all ^> G 
L 1 (iP 00 ) and the ergodicity follows from the development in Section IV. 2 of [lfij . This 
proves Lemma n D 

We continue with the proof of Theorem ^ Next, we will show that condition (j2.1|) 
is satisfied. 

Lemma 2. Under the assumptions of Theorem Q condition (J2.1|) is satisfied with 
a = 1/4. 



Proof. Observe that 



n-1 

E n ' 

k=0 



(J 



n—1 p 

£ E P^{Xi = x)P^{X j = y)g{T x u;)g{T y u)P{duj). 



Note that the integral is taken with respect to IP instead of Poo- This is because all 
the integrands depend on to through &o- 

Now, since IP is a product measure and g has mean zero, the summands in the 
above sum vanish unless i = j and x = y. Therefore, one has 

2 



n-1 
k=0 



9 



n—1 „ 

9\\IY, PoAX k = X k )P(duj) 

k=0 J 



where X n and X n are two independent walkers driven by the same environment uo. 
We will denote their law by Pq . To check condition (|2.1|) one needs to find the 
asymptotic behaviour of the above sum. 
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Notice now that, under f Pq qIP^cLuj), the difference Y n = X n — X n performs a 
random walk on E with the following kernel: 



<?(°, y) = ^2 JE(7r 0tei+z 7t 0iei+z+y ), 

q{x,y) = >^ ■^(7ro, ei+z )^(7ro, ei +z+ j/ -s) , if x ± 0. (4.1) 



z£E 



This walk is actually a homogeneous symmetric random walk on E, perturbed at 0. 
Due to Lemma 3.3 of 3 one then has 



n— 1 « 

£ / P£ (X fc = X fc )iP(^) = ^(v^). 

fc=0 ^ 



Therefore, condition (|2.1jl is satisfied and we are done. □ 



Remark 3. Our application of Lemma 3.3 from [12| may appear unjustified because 
of the additional hypotheses l|| employs. However, (2.2) in 2| is superfluous. Once 



one notices that 



g(0,?/)>0^go(0,y)>0, 



one can apply P7.1 on page 65 of Spitzer [2.1] to reduce the treatment to a situation 
where (2.2) holds. Here, q is the transition kernel of the unperturbed random walk 
and is defined by (|4.1|) . for all x. Also, in Lemma 3.2 of 2| the authors reference 



P12.3 of Spitzer's book, which requires more than just two moments on go- However, 
one can instead use (3) of section 12 on page 122 of j^jj. Furthermore, Lemma 3.1 
of [l2| is not needed for our purposes, since we only need the u ppe r bound in (3.22) 
therein. Lastly, the reference to P7.9 of 21 , in Lemma 3.3 of 2|> can be replaced 



by P7.6. This allows to discard "strong aperiodicity" . 

Now that we have verified all the assumptions of Theorem |21 are satisfied, we can 
conclude the proof of Theorem ^ Indeed, Theorem |21 implies that the claim of 
Theorem ^ holds for iPoo-a.e. uj. But since everything depends on uj only through 
©0) an d JPoo — IP on ©o, the same holds for iP-a.e. uj. 

Of course, Theorem |21 yields a different formula for the diffusion matrix. However, 
the annealed invariance principle has to have the same diffusion matrix which, as 
we have mentioned in the introduction, is precisely D. We leave it for the reader to 
double-check, with a direct calculation, that the two formulae do coincide. □ 

Remark 4. Note that (Xi + Mi) ■ e± = and, therefore, the Brownian motion in 
question is actually //-dimensional or smaller. This is of course also clear from the 
formula for D. 
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Appendix A. An invariance principle for a vector-valued martingale 

DIFFERENCE ARRAY. 

In this appendix we give a proof of the vector-valued martingale invariance prin- 
ciple, needed in the proof of Theorem |21 that is based on the corresponding scalar 
result. The scalar version appears as Theorem 7.4 in Chapter 7 of Durrett's textbook 
(loj . It is noteworthy that an invariance principle for general Banach space valued 
martingale differences that unifies several results in the literature has been proved by 



To avoid confusion with time t we write in this section A T for the transpose of 
a vector or matrix A, instead of the A 1 we have used in the rest of the paper. An 
element of H d is still regarded d X 1 matrix. 

Let (f2, Q, P) be a probability space on which are defined sub-cr-algebras Q n ^ C Q 
and III d - valued random vectors Y n>k . We say that \Y n ,k-,Qn,k :n>l,l<A;<n}is 
an Unvalued square-integrable martingale difference array if the following properties 
are satisfied: 

(i) Y Utk is (^-measurable, G n ,k-i C G n ,k, 

(ii) E(\Y n , k \ 2 ) < oo, 

(iii) E(Y nM \G n ,k-i) = 0, 

and in the last condition we take G n ,o = {0, Q}. Define the IR^- valued processes S n (-) 
by 

[nt] 

Sn(t) = Y n ,k 
k=l 

for < t < 1. The paths of S n (-) are in the Skorohod space ^([0,1]) of Unvalued 
cadlag paths on [0, 1]. Recall now from Remark^the definition of a Brownian motion 
with diffusion matrix T. One then has the following: 

Theorem 3. Let {Y n! k,Q n ,k ■ n > 1,1 < k < n} be an lR d -valued square-integrable 
martingale difference array on a probability space (Q,Q,P). Let T be a symmetric, 
non-negative definite d x d matrix. Assume that 

[nt] 

lim V ]E(Y n k Y^ k \G n,fc-i) = tT in probability, (A.l) 

n— >oo ' ' ' 
k=l 

for each < t < 1, and 

n 

lim } E(\Y nk \ 2 l{\Y n k\ > E}\G n k -i) = in probability, (A.2) 

n— >oo ' ' 
k=l 

for each e > 0. Then S n (-) converges weakly to a Brownian motion with diffusion 
matrix T on the Skorohod space D^dO, 1]). 
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Proof. The key to the proof is to apply a scalar martingale invariance principle to 
one-dimensional projections of S n , conditional on the past. 

Fix < s < 1. Consider k time points < si < s 2 < ■ ■ ■ < s k < s, and a 
non-negative, bounded continuous function \1/ on H fcd . Abbreviate 

Z n = ^ (S n (si), S n (s 2 ), ■■■ , S n (s k )) . 

Assume E(Z n ) > for all n. Pick also a non-zero vector 6 G IR^, and a bounded 
continuous function / on the Skorohod space Z?ir([0, 1 — s]) of scalar- valued paths. 
Finally, let Bg denote a one- dimensional Brownian motion with variance E(Bg(t) 2 ) = 

e T vet. 

Lemma 3. We have the limit 

Um *(/(»• = mm (A . 3) 

Proof. Define a probability measure P n on Q by 

P n {A)^^—E{\ A -Z n ). 

E n denotes expectation under P n . Since Z n is G n ,[ns] -measurable, we have 

E n {h\G n ,k) = E(h\G n ,k) 

for any /c > [ns] and /i G L 1 (P). 

Define a scalar martingale difference array {X n}in , T n ^m :n>l,l<m<n — [ns]} 

by 

A^n,m ^ ' ^n^rasj+m and ^ ^ m ^n,[ns]+m' 

Observe first that by assumption (jA.l|) one has 

[nt] ^ [nt] 
Vn t [ n t] = y^^E^XljJ 7 n ,j-l) = ^ E (X*j I Gn, [ns] +j-l) 
j=l j=l 

{[ns] + [nt] [ns] 
E(Y n>k Yl k \Gn,k-l) -J2 E ( Y n,kY^ k \Gn,k-l, 
k=l k=l 

— > t6 T Y6 in probability as n — > oo. 

In case the reader is concerned that the first sum on the second-last line above goes 
up to j = [ns] + [nt] , we point out that assumption (jA.2|) implies 

lim max \Y nk \ =0 in probability. (A. 4) 

n^oo Kk<n ' 



Thus the limits are not affected by finitely many terms. (|A.4|) follows from Dvoret- 
sky's Lemma, by an argument that can be found in the proof of Theorem (7.3) in 
Section 7.7 of Durrett [10( (see part (f) of that proof). 
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Next, by assumption (jA.2j) . for any e > there exists e > such that 

n— [ns] 
0=1 

n 

< \e\ 2 Y,E{\Y ntk \ 2 i{\Y nd \>e Q }\g n ^ x ) 

k=l 

— > in probability as n — > oo. 

We have verified the hypotheses of the Lindeberg-Feller Theorem for martingales 
that appears as Theorem (7.3) in Section 7.7 of Durrett [To| . Consequently the 
process 

[nt] 

f/ n (t)=]TX nJ 
3=1 

= 9 ■ S n (s + t) - 9 ■ S n (s) - 9 ■ Y nMs+t)] l{[ns] + [nt] < [n(s + *)]} 

satisfies 

E n (f(U n )) - E(f(B e )). (A.5) 

To be precise, Durrett 's theorem treats the continuous process 6 ■ S n (-) defined by 
linear interpolation: 

S n (t) = S n (t) + (nt - [nt])Y nAnt]+1 , < t < 1. 

But by fOjl . 

sup 5^(0 — S n (t)\ — > in probability, (A. 6) 

0<t<l 

so the cadlag and continuous versions converge weakly together. 

(jA.5|) is the same as (|A.3[) . again because by ()A.4|) whether [ns] + [nt] differs from 
[n(s + t)] is immaterial for the limit. Lemma El is proved. □ 

Now we prove Theorem |H1 from this lemma. First, by taking s = and \P = 1, 
9 ■ S n converges weakly to the Brownian motion Bg, for each vector 9. Thus all the 
scalar processes obtained as projections of {S n } are tight, and hence the vector-valued 
processes {S n } themselves are tight on the space C ]R d([0, 1]). And then by (jA.6j) . the 
vector-valued processes {S n } are tight on the space ^^([0, 1]). This detour via the 
continuous processes {S n } to get tightness of {S n } was used because tightness of 
vector-valued processes from projections is not as obvious for cadla g pa ths as it is for 
continuous paths (see Exercise 22 from Chapter 3 of Ethier-Kurtz 

Let a process X be a weak limit point of {S^}, and let S nj be the subsequence along 
which S nj =^> X. The map n h- > 9 ■ n from D M d([0, 1]) into .Dni([0, 1]) is continuous, 
hence 9 ■ X has the distribution of the Brownian motion B$. It follows that X has a 
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version with almost surely continuous paths. Then the finite-dimensional marginals 
converge weakly: 

(S nj (si), S nj (s 2 ), ■■■ , S nj (s k )) (X(si),X(s 2 ), ■ ■ ■ ,X(s k )) ■ 

From all this we conclude that along the subsequence rij the left-hand side of (|A.3|) 
converges to 

E(f(8-X(s + -)-8- X(s)) g (X( Sl ), ■ ■ ■ , X(s k ))) 
E(V(X( Sl ),--- ,X(s k ))) 

By (IA.3J) this must equal E(f(Bg)). Since the time points {si} and the function \& 
are arbitrary, it follows that 

E ( e iHx(s+t)-x( s) ) i x(r) . o < r < s) = E (e ifl «W) = er*™. (A.7) 

Varying the vector 9 here implies that the increment X(s + t) — X(s) is independent 
of the past up to time s, and is distributed like the increment of a Brownian motion 
with diffusion matrix T. Inductively on the number of increments we conclude that 
X has independent increments, continuous paths and the correct Gaussian finite- 
dimensional distributions, which makes it a Brownian motion with diffusion matrix 

r. 

Note that it is critically important for this argument that in (jA.7|) we can condition 
on {X(r) : < r < s} and not only on {6 ■ X(r) : < r < s}. This latter would 
not suffice for the conclusion, as indicated by Exercise 2 in Chapter 7 of This 
completes the proof of Theorem EH □ 
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